On the Properties of Some Systems 
that Distort Signals — II 

By I. W. SANDBERG 

(Manuscript received April 19, 19G3) 

In this paper we study (he recoverability of square-integrable band-limited 
signals (with arbitrary frequency bands) that are distorted by a frequency- 
selective lime-variable nonlinear operator and subsequently are bandlimited 
to the original bands. The distortion operator characterizes a very general 
class of systems containing linear time-invariant elements and a single 
time-variable nonlinear element. The subsequent bandlimiting of the sys- 
tem's output signals can be thought of as being due to transmission through 
a channel that performs filtering. 

Our principal residt asserts that, under certain conditions that are satis- 
fied by many realistic systems, it is possible to uniquely determine the band- 
limited input to the system from a knowledge of the bandlimited version of 
the out-put, in spite of the intermediate distortion which generally produces 
signals that are not bandlimited to the original frequency bands. We show 
that the input signal can be determined by a stable iteration procedure in 
which the approximating functions converge to their limit at a rate that is 
at least geometric. 

I. INTRODUCTION 

In this paper we study the recoverability of square-integrable band- 
limited signals (with arbitrary frequency bands) that are distorted by a 
frequency-selective time-variable nonlinear operator and subsequently 
are bandlimited to the original bands. The distortion operator character- 
izes a very general class of systems containing linear time-invariant 
elements and a single time-variable nonlinear element. The subsequent 
bandlimiting of the system's output signals can be thought of as being 
due to transmission through a channel that performs filtering. 

Our principal result asserts that, under certain conditions that are 
satisfied by many realistic systems, it is possible to uniquely determine 
the bandlimited input to the system from a knowledge of the band- 
limited version of the output, in spite of the intermediate distortion 
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which generally produces signals that are not bandlimited to the original 
frequency bands. Of course the distortion operator is assumed to be 
known. We show that the input signal can be determined by a stable 
iteration procedure in which the approximating functions converge to 
their limit at a rate that is at least geometric. When the physical sys- 
tem consists of only a single nonlinear element, our result reduces to 
that of Landau and Miranker, 1 and Zames. 2 

In the electronic circuitry of a communication system, it is often the 
case that an ideally linear amplifier is supplied with an approximately 
bandlimited input signal and that the circuitry subsequent to the ampli- 
fier introduces approximate bandlimiting. Under the assumption that 
the bandlimiting is ideal, our results imply that in many cases it is possi- 
ble to completely reverse the effect of nonlinear distortion that may be 
introduced by such an amplifier due to the malfunctioning of, for ex- 
ample, a transistor or its bias supply, even though, as is typically the 
case, the transistor may be in a feedback loop. Of course it is necessary 
to know the properties of the distorting circuit. Results of this type may 
be useful in situations in which received signals are recorded and the 
time delay introduced by the recovery scheme is not important. For 
example, it is conceivable that this type of result may be useful in im- 
proving the quality of distorted signals obtained from a transmitter in 
a space vehicle containing a television camera, in which the distortion 
is due to a faulty video amplifier. 

Section II considers some mathematical preliminaries. In Section III 
we state our principal results after discussing in detail a mathematical 
model of the physical system to be considered which focuses attention 
on the influence of the time-variable nonlinear element. Sections IV 
and V are concerned with the proof of the results. In particular, Section 
V considers the rate of convergence and stability of the recovery proce- 
dure. Section VI is concerned with some results that relate to the neces- 
sity of the conditions introduced earlier. 

II. PRELIMINARIES 

It is assumed that the reader is familiar with the contraction-mapping 
fixed-point theorem stated in Part I. 34 

As in Part I, £ 2 denotes the Hilbert space of complex- valued square- 
integrable functions with inner product 



(fa) = [ fgdt 

J— 00 
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hi which 9 is the complex conjugate of g. The norm of / [i.e., (/,/)] is 
denoted by || / ||. The intersection of the space £ 2 with the set of real- 
valued functions is denoted by £ 2R • 

We take as the definition of the Fourier transform of /(/) in £■> : 



'(«) = f/( 

**— CO 



F(o>) = f(l) e~' ul dt 



and consequently 



fit) - ^ [ F(») •*" du. 
With this definition, the Plancherel identity reads: 

/CO i»00 

/(Ofl(0 dt = / F(a)G(a) dco. 
oo - J— 00 

As the notation above suggests, lower and upper case versions of a letter 
are used to denote, respectively, a function and its Fourier transform. 
We shall be concerned with the following subspace of £>z R : 

CB(fi) = |/(0 |/(0 ££ 2 «; F(«) = 0, cofrfl} 

where fi is a union of disjoint intervals. The measure of 12 is denoted by 
iu(fl), which, unless stated otherwise, is not assumed to be finite. In par- 
ticular, ft may be the entire real line. 

The operator that projects an arbitrary element of £* R onto (B(£2) is 
denoted by P. In electrical engineering terms, P is an ideal filtering 
operation. 

The symbols I and O denote, respectively, the identity operator and 
the null operator (i.e., Of = for all / e £2). 

III. MATHEMATICAL DESCRIPTION OF THE PHYSICAL SYSTEM AND STATE- 
MENT OF PRINCIPAL RESULTS 

Consider a nonlinear time- variable element imbedded in a linear phys- 
ical system. Let si and s-> , respectively, denote the system's input and 
output signals, and let v and iv, respectively denote the input and output 
signals associated with the nonlinear device, which is assumed to be 
characterized by the equation 

w = <p(v,t) = <p[v], (1) 

where ip(v,t) is a real-valued function of the real variables v and t. 

It is assumed that v, w, s 2 e £-> k , «i £ (B(fi), and that there exist well- 
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defined linear operators r and A, with domain (B(fi) X £ 2 r , such thatf 
v = r[si , w] and s 2 = A[si , to]. 

We shall be concerned throughout with the four linear operators A, 
B, C, and D derived from r and A in the following manner: 

v = r[«i , to] = r[si , 0] + r[o,io] 

= Asi + Cw (2) 

s 2 = A[«i , to] - A[«i , 0] + A[0,to] 
= D«! + Bio. (3) 

3.1 Representation of the Operators A, B, C and D 
We assume throughout that 

A/ = / a(t - T)f( T )dr, B/ = f_ b(t - r)f{r)dT 
C/= ( c(t - r)/(r)dr, D/ = [ d(t-r)f(r)dr 

J— to J— oo 

where each of the real symbolic functions a(t), b(t), c(t), and d{t) is 
most generally the sum of an element of £ 2 « and a delta function. It 
is assumed throughout that | C(a) \ and | B(oj) | are uniformly bounded 
for all co and that | A(u) \ and | D(w) | are uniformly bounded for all 
to £ fi. It follows that C and B are bounded mappings of £ 2 « into itself 
and that A and D are bounded mappings of ffl(O) into itself. 

3.2 The Projection Operation and the Basic Flow Graph 

We shall suppose that s 2 , the system's output signal, is the input to a 
device that projects signals in £ 2fi onto the subspace (B(J2). This device 
may be thought of as representing an ideal transmission channel of the 
low-pass, bandpass, or multiband type. If the output of the device is 
denoted by s 3 , then clearly 

s 3 = Ps 2 = T _1 PTs 2 (4) 

where 

p = P(co) = 1, toe £2 
= 0, to* £2 

and Ts 2 denotes 82 , the Fourier transform of s 2 . 

t This assumption is almost invariably satisfied in mathematical models of 
physical systems of interest. 
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Fig. 1 — Signal-flow graph characterization of the relation between s I , S2 , s t , 

v, and w. 

The equations we have introduced give rise to the signal-flow graph 
shown in Fig. 1 which summarizes the basic situation. 

Our primary interest is in (i) obtaining conditions under which s 3 
uniquely determines Si , when Si is known to lie in the same subspace as 
s 3 [i.e., in (B(Q)], and (ii) obtaining a technique for recovering Si . 

3.3 The Time-Variable Nonlinear Element 

We shall denote by ^(iv,t) the inverse nonlinear characteristic; that 
is, \fs(<p[v],t) = v for all v and t. It is assumed throughout that ^(0,0 = 
for all /, that \f/ [w(t)] is a measurable function of t whenever w is measur- 
able, and that there exist two positive constants a and /3 with the 
properties that \{a -\- /3) = 1 and 

a(wi — W2) ^ t^Oi , - ^(wa , = P( w i ~ WO ( 5 ) 

for all t and all W\ ^ iv-> . Of course no loss of generality is introduced by 
the normalization J(a -f 0) = 1, which happens to be convenient for our 
purposes. Observe that < a i£ 1. 
It follows from (5) that 

&~\vi - th) ^ <p(vi , t) - tp(v 2 , ^ a~\ Vl - v 2 ) 
for all t and all Vi ^ v* . Observe that w c £->n if and only if v c £ 2 r • 

3.4 Assumptions Regarding \ A(u) |, | B(u) |, and \ D(u) \ 

In addition to the uniform boundedness of | A(u) |, | B(u) |, | C(u) \, 
and \D(u) | mentioned earlier, it is assumed, unless stated otherwise, 
that there exists a union of disjoint intervals ft D such that £2 D £ $2, 

|D(«)| = 0] 

I B(u) I ^ fcl OJffifl, 

|A(«)| ^ h 
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and 

I D(«) I £ fa , u e (a - n D ) 

where &i , /c 2 , and A - 3 are positive constants. In most cases of engineering 
interest either fl D = fi or £l D is the null set.f 

3.5 Statement of Principal Results 

Our main result is 
Theorem I: Let A, B, C, D, a, and \f/ be as defined in Sections 3.1, 3.3, and 
3.4. Let 

inf | C - AD~'B - 1 | > 1 - a 
wc(a-a D ) 

inf | C - 1 | > 1 - a. 

Then to each s 3 £ (B(£2) there correspond unique functions Si e (B(ft) and 
w, v, s 2 e &ir such that 

Sz = Ps 2 

s 2 = Dsi + Bw 

v = A&'i + Civ 

v = \f/[w] 

\i.e., such that (1), (2), (3), and (4) are satisfied]. Furthermore ij 

h = Ps 2 

S 2 = Ds( + B?7> 
v = Asi + Ct3 
v = \f/[w] 
where w, v, s 2 e £ 2R and S\ , s 3 £ (B(S2), 

|| Si — Si || ^ A'4 || «3 — S3 || 

where k t is a positive constant that depends only on A, B, C, D and \f/. 

Suppose that \l/[w] = Cw + Asi {i.e., (2) with v = \f/[w]} possesses a 
unique solution w £ <£ 2R for any Si £ (B(ft) and that if \f/[w] = Cw + Asi 

t The assumptions in this section facilitate a common treatment of these two 
important cases. Observe that, with the exception of these cases, it is assumed 
here that | D(w) | is discontinuous on O. However, as indicated in the Appendix 
this is by no means a necessary condition for the recoverability of si . 
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in which h e (B(ft) and w e £ 2 r , || w — w || ^ fr B || si — Si ||, where k t 
is a constant that does not depend on Si or Si . [A direct application of 
Theorem II (in Section IV) shows that this is the case if inf | C — 1 | > 

a 

(1 — a).] It follows directly from the properties of i^'and the assump- 
tions regarding A, B, C, and D that if si e (B(ft), there exist unique 
functions v, s 2 , s 3 c £ 2 r such that (1) (2), (3), and (4) are satisfied. 
Let 4> denote the operator that associates with each si e (B(ft) the corre- 
sponding s 3 . The assumptions regarding \f/[w] = Cw + Asi together with 
the boundedness of B and D imply that * is a bounded mapping of (B(ft) 
into itself. Under the conditions stated in Theorem I, <I> possesses a 
bounded inverse. 

The invertibility conditions are established in Section IV and the 
boundedness of O - is considered in Section V. 

The method used to establish the invertibility conditions is construc- 
tive. In particular, 4»~ s 3 can be computed in accordance with a stable 
iteration procedure for which the successive approximations converge 
in the £ 2 r norm at a rate that is at least geometric. The approximations 
converge also in the supremum norm at a rate that is geometric or 
greater if /x(ft) is finite. 

As indicated earlier, in most cases of engineering interest either 
ft D = ft (the single-loop feedback system case), or ft D is the null set 
(i.e., the magnitude of the "direct transmission" D(<ji) is uniformly 
bounded away from zero on ft). The invertibility conditions stated 
above are satisfied in many cases of practical interest. 

The situation considered by Landau and Miranker, and Zames cor- 
responds to one in which A = B = I, D = C = 0, and ft D = ft. The 
inequalities are obviously satisfied in this case. In fact they are satisfied 
when ft D = ft and O(co) = 0, w e ft. More generally, observe that the in- 
equalities are met if and only if (C — AD~ B), for all co e (ft — ft D ), and 
C, for all a) g ft, are bounded away from the disk centered in the complex 
plane at [1,0] and having radius 1 — a where < a ^ 1. 

IV. DERIVATION OF INVERTIBILITY CONDITIONS 

In the following discussion we shall denote by P D the operator that 
projects elements of £ 2 r onto (B(ft D ). That is, 

P A f=T" 1 P T/, fe£ 2R (6) 

where 

P D = Pb(u) = 1, w e9. d 

= 0, w e ft D 
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and, as before, T/ denotes the Fourier transform of /. Recall that D is 
an invertible mapping of (B(Q — fio) into itself, that A and B are in- 
vertible mappings of (B(ft ) into itself, and that D annihilates (B(£2 D ). 
We shall denote by D _1 the inverse of the restriction of D to (B(fl — ft ), 
and by A -1 and B -1 , respectively, the inverses of the restrictions of A 
and Bto (B(Q/>). 
From (3) and (4) 

s 3 = Dsi + PBw, si € <B(G) (7) 

and from (2) and \f/[w] = v 

$ [w] = Cw 4- Asj . (8) 

Our objective is to determine w in order to find Si from (7) and (8). 
The corresponding functions s 2 and v can of course be computed from (3) 
and v = rp[w]. 

Since D annihilates (B(ft D ), P s 3 = P D Bw and, since P c and B com- 
mute, 

P D w = B _1 P D s 3 . (9) 

The problem therefore reduces to the determination of (I — P D )w>. 
Before proceeding it is convenient to set w a = P D w and w b = (I — I*d)w, 
and to introduce 

Definition I: Let 

r,(x) = - x, x ^ 1 

= x — a, x ^ 1. 
From (8), 

(I - P D )*[w a + w b ] = Cw 6 + A(P- P D )s! , (10) 

since C and A commute with (I — P D ). From (7), 

(P - P D )s 3 = D(P - P D )sx + (P - P D )Bw, 
and 

(P - P c )si = D _1 (P - Pd)s 3 - D _1 (P - P D )Bw. (11) 
Thus, 

(I - P D )^[w a + w b ] = Cw b - AD _1 (P - P D )Bw b 4- AD _1 (P - P D )s 3 
from which 
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(I — Po) |^[w a + Wb] — foWb] 

= [C - AD _1 (P - Px,)B - #J] Wb + AD _1 (P - P D )s 3 

where ^o is a real constant to be chosen subsequently. 

Thus, regarding [C — AD _1 (P — P e )B — \]/J] as a mapping of the 
orthogonal complement of (B(ftr>) into itself, and assuming that it pos- 
sesses a bounded inverse [C — AD _1 (P — P D )B — i^I] - , 



Rwb = w b 



where 



Rio h = [C - AD '(P - P„)B - -AoIJ '(I - Pi,)\yp[w a + w b ] - + w b ) 

- [C - AD~'(P - P C )B - WT'Afi^CP - Pd)s 3 . 

The operator R is a mapping of a complete metric space into itself. 
We next establish a condition under which R is a contraction. Let H = 
[C — AD -1 (P — Pd)B — i^ol] -1 , and let/and g belong to the orthogonal 
complement of (B(S2/>). Then 

|| R/ - Rg || g || H(I - P„) || • || +[w a + /] - f[w a +g]- Mf - g) II 

^ ||H(I - P c ) ||n(^o) 11/ - g II, 

since 

\fr[w a + /] - ^[w a + g] 



f-g 

Thus R is a contraction for some \p if 



— 1A0 



^ yifo) 



r = inf ||H(I - P fl ) II 77(^0) < 1. 
fo 



(12; 



It turns out that the optimal choice of \{/q is unity, the median of a and 
8. Consequently we could have simply set \J/ = 1 at the outset. However, 
we prefer to establish the significance of this choice. 

4.1 Evaluation of || H(I — Po) || 

Let H = [C - AD~\P - l\)B - ^ ] _1 with the understanding that 
D~\P - P D ) - 0, <a e (Q - Q D ). Our result isf 

Lemma I: 

||H(I - P D ) || = ess sup \H(co) |. 

t The notation ess sup Q(u) denotes inf sup Q(u) where 91 is an arbitrary zero- 
measure subset of the real line. 
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Proof: 

The norm of H(I - P B ) is sup{|| z ||; ||/|| = 1} where z = H(I - 
P D )f and f e £ 2R . An application of the Plancherel identity yields, in 
terms of the frequency domain representation of H, 



ii 2 

z 



= _L f |F(co)| 2 -|F( w )| 2 ^. 

27T Jatn n 



»#0d 

Hence 

Bip{||*||; ll/H = 1} ^ ess sup | ff(co) |. 

However if ess sup \H(co) \ < <*>, for any e > there exists a set of 

nonzero measure £ which is disjoint from tt D and such that | H{u>) | ^ 
ess sup | H(w) | - e, co e 8. Since | F(«) | is permitted to be nonzero only 

on 8, it follows that 

sup{||z ||; ||/[| = 1} ^ ess sup | ^(co) | - e. 

o,(Sl D 

Thus if ess sup \ H(<a) \ < «, 

UfQji 

|| H(I - P„) || = ess sup | H(u) |. (13) 

It is clear that (13) remains valid if ess sup | H(<a) \ = *> . This proves 

the lemma. 

It follows from (12) and Lemma I that 

r = inf ess sup | [C - AD~\P - P D )B - ^o] -1 I *lM- (14) 

4.2 Determination of fa and Statement of Theorem II 

The following lemma indicates that the optimal choice of i/'o is inde- 
pendent of [C - AD~\P - P D )B]. 

Lemma II: Let £ 6e a complex number and suppose that 
Then 

\z-h\~\(h) 25 1*- ir*(i). 

Proof: 

Suppose first that iJ/q ^ 1 and that 

I £ - iM > W - to), * > 1. 
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Then, since |$ — tol^=|£— 1| + |1 _ to|, 

| I - 1 | + | 1 - to | - fc(l - to ) > k(0 - 1), 
and hence | £ — 1 | > fc(j8 — 1). Suppose now that to ^ 1 and that 

If- to I > fc(to - «), fc > l. 

Then, 

U - 1 | + | to " 1 1 - /.-(to - 1) > fc(l - a), 

and hence | (j — 1 | > fc(l — a). 

It follows from (14) and Lemma II that if r < 1, 

r = ess sup | [C - AD~\P - P D )B - If 1 |q(l) 

utQo 

= ess sup | [C - AD~\P - P D )B - l]" 1 | (1 - a). 

At this point we are in a position to state 

Theorem II: Let A, B, C, and D be the bounded linear operators defined in, 
Section 3.1. Let D, but not necessarily A and B, have the properties stated 
in Section 3.4. Let D~ denote the inverse of the restriction of D to (B(fiz>), 
and let P D denote the operator that projects elements of £ 2 r onto (B(fi D ) . Sup- 
pose that 

r = max [r { , r 2 ] < 1 , 

where 

n = ess slip | [C - AD~ l B - 1] _1 | (1 - a) 
o.r(n-n C ) 

/■•j = ess sup I [C — l] -1 | (1 — a). 

Then for any iv„ and g, respectively elements of ($>{Q, D ) and its orthogonal 
complement with respect to £, 2 r , there exists a unique Wb in the orthogonal 
complement of (B(S2/)) such that 

(I - PiOfljffl. + w b ] = [C - AD -1 (P - Pn)B]w b + g. 

In fact, Wb = Urn Wbi where 

i-»w 

Wbd+i) = [C - AD~'(P - P«)B - I] _1 (I - P D ){f[w a + w bi ] - w bi ] 

- [C - AD _1 (P - P C )B - VT l g 
and Who is an arbitrary element in the orthogonal complement of (B(fl ). 
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// Wb is a solution corresponding to w a and g, 

|| w b - * || £ Y~ r ' Wa ~ * I' + (1-rKl -a) ' ' " * "' 

Proof: 

With the exception of the last inequality, the proof follows from the 
fact that if r < 1, R (with \f/ = 1 ) is a contraction mapping of a complete 
metric space into itself, t The inequality is obtained as follows. Let 
J = [C - AD _1 (P - P C )B - If 1 (i.e., let J be H with $ = 1). Then, 
since 

w b = J(I - PdM^K + Wb] - Wb) - Jg, 

W b - Wb = J(I - Pj>){tflfli + Wb] - ^[W a + W b ] - (W a + Wb) 

+ (w a + Wb)} - Jig - g). 

Therefore 

|| W b - W b \\ ^ || J(I - Pd) II 1?(1) || W a - W„ + W b - Wb || 

+ II jci — P»)IHIf-fll, 

and since r = || J(I - P e ) || i?(l), *?U) - (1 - «), and 

|| W a - W a + W b - W b || ^ || W a - ld a || + || W b ~ W b ||, 

|| W b - W b || ^ ^ || Wa - Wa || + ^j -wt: r || ~ <7 II- 

1 — r (1 — r)(l — a; 

With regard to the "essential supremum" notation used in the state- 
ments of Lemma I and Theorem II, it is of course true that 

ess sup | H(<a) | = sup \H(u) | 
in at least almost all cases of engineering interest. 

4.3 The Complete Recovery Scheme 

Let us now consider our over-all objective, the recovery of Si . From 
(8) and (11), using the definition of A -1 , 

(P - P D )s, = D _1 (P - P D )s 3 - D _1 (P - V D )Bw 

P dSi = A _1 P D j^N - Cw}. 

t In particular, our assumption regarding the inverse of [C - AD _1 (P - P D ) - 
B - I] is satisfied, since | C - AD~ l (P - P D ) - 1 | is bounded away from zero 
for all u in the complement of ifo . 



DISTORTED SIGNALS 103 

Therefore, 

s, = (P - Pd)s, + P oSl = [D _1 (P - P«) - A-'CB-'PoJss 

(15) 
+ A-'PalflB-'Pi* + ufc]} - D"'(P - P D )Bwj, 

where we have used (9), the fact that (P — P D )Bwj a = 0, and the 
identity A _1 P & CB _1 Pz,.s 3 = A _1 CB _1 P D s 3 . This proves the first part of 
Theorem I. The second part, which is concerned with the boundedness 
of *S>~ , is considered in Section 5.1. 

We define Si„ , the nth approximation to Si , by 

S ln = [D _1 (P - P D ) - A^CB^PoJSs + X^PaMB-'PflSa + w bn ]} 

(16) 

- D _, (P - P D )Bw bn 

where Wb n is the nth approximation to Wb as defined in Theorem II. Ob- 
serve that 

Si„ - «i = X _1 P w {^[B _1 P u .s- 3 + w bn ] - ^[B _1 P D s 3 + w b ]} 

- D _1 (P - P D )B(w 6 „ - w b ), 

from which, using the right inequality of (5) satisfied by i/-, 

|| Si„ - «i || ^ { || X _1 P D || + || D _1 ( P - P D )B || } || w bn - w b || . (17) 

An argument very similar to that used in the proof of Lemma I suffices 
to show that 

|| X _1 P W || = ess sup | A' 1 | (18) 

!| fr'(P - P«)B || = ess sup | D~ l B |. (19) 

a.i:(n-Q D ) 

Our assumptions regarding A and B imply that the right-hand side of 
(18) and the right-hand side of (19) arc bounded. Therefore, since Wb = 
lim Wb„ , ( 17 ) implies that Si = lim S\„ . 

n-»» n-»oo 

The convergence of s in to s x established in the last paragraph is in 
the mean-square sense. If ^t(Q) < =o, it is also true that s ]n converges 
to S\ pointwise uniformly in /, that is 

lim sup | Si„ — Si | = 0. 

71 -CO / 

This result follows from the inequality:! 

t This inequality is proved in Ref. 1 for the case in which ft is a single interval 
centered at the origin. The extension to arbitrary sets of finite measure is trivial . 
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D-'(P-P D )-A- 1 CB-'pJ 



L n w bn -D-'(P-P D )B 



B _, P„ 



I 



A _, P r 



Fig. 2 — Idealized recovery scheme, 
and the fact that Si„ , $i e (B(fi). 




-AD-'fl-Pt,) 



Fig. 3 — The iterative operation L„ . 



4.4 Signal-Flow Graph for a Complete Recovery Scheme 

One complete idealized scheme for obtaining the nth approximation to 
8i , based on (16) and the solution for w b given in Theorem II with g = 
AD _1 (P - P D )s s and w b0 = 0, is summarized in Fig. 2. The iterative 
operation f L„ is shown in detail in Fig. 3 in which, as denned earlier, 

t In the special case in which fi D is the null set and C — AD~ 1 PB = identically 
in w, w = v[AD -I s 3 ] and hence the iteration stage is not required. The condition 
that C — AD~ 1 PB vanish identically in «, under which O is by no means a trivial 
mapping of ffi(0) into (B(0), is equivalent in engineering terms to requiring that 
the feedback transmission, for w t Q, and the null feedback transmission, for to e 
fi, both vanish. 
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J = [C — AD (P — P B )B — I]~ . Fig. 4 shows a flow-graph representa- 
tion of J in terms of [C — AD _1 (P — Pj>)B] and elementary operations. 
The flow graphs in Figs. 2 and 3 simplify in obvious ways in the impor- 
tant special cases in which D = O on (B(fl) or D possesses a bounded 
inverse on (B(fi). 

The analog implementation of the scheme presented in Fig. 2 requires 
consideration of the time delay inherent in the approximation of the 
impulse response functions corresponding to the nonrealizable operators f 
P and P/> , as well as the time delay that might be required in the ap- 
proximation of J. These considerations imply that time delay sections 
must be inserted at various points in the recovery system and that the 
time variation of the nonlinear elements must be staggered. Of course 
the output of the recovery system will be a delayed version of an ap- 
proximation of Si(t). 




[C-AD-'(P-P D )B] 
Fig. 4 — Flow-graph representation of the operator J. 

There are many variations possible in the implementation of the re- 
covery system. For example, the iteration can be performed with a 
recording device and a single typical stage of the type used in Fig. 3. 

V. RATE OF CONVERGENCE AN!) STABILITY OF THE RECOVERY SCHEME 

The key element in the recovery scheme is of course the iteration pro- 
cedure. We show first that the approximating functions w^ converge to 
their limit Wb at a rate that is at least geometric. This type of convergence 
is a direct consequence of the fact that Wk = R'ttfeo where R is a con- 
traction mapping. 

Since 

Wbi = W b0 + [iflu - »',,„] + [ttfcj - W b i] + • • ■ + [Wbi - Wb(i-i)], 
I! Wbi - W b || = || [Wbu+u - Wbi] + N,(,+2) - Wbti+i)] + • • • || 
^ || Wb(i+i) — Wbi || + I' Wb(i+2) — Wb(i+\) || + 

Repeated applications of the inequality : 

t Of course we are ignoring the cases in which P = I or P D = O. 
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|| Wbi — Wh(l-U (I = || RWb(J-l) — Rt0&(|-2) || 

^ T || WbU-i) — W, H i--l) ||, / ^ - 

lead to 

i 

II Wb,- - Wb || ^ ; II Wbi - wm ||- (20) 

If W60 = 0, w bl = J(I - P D )t/'[B' l P„.s; ! ] - JAD-'(P - P D )s 3 , and 
hence 

|| tow - 106 || £ y-^ || J(I - Po) I-AIB-P,,^] - B^PoSa 

- AD _1 (P - P D )s 3 }|| 

i 



J(I -P B )|| (*(1) II B 'P 



- 1 - r 

+ || AD _1 (P - Pd) III II S3 II 

^(1|B-P„|| + " A6 "' 1 (P - P ° ) " H| 5 3 
1 — r \ \ — a ) 

where, in accordance with the arguments nsed in the proof of Lemma I, 

|| B~'Pz, || = ess snp | B~ | 

wea D 

|| AD _1 (P - Pd) II = ess sup | AD' 1 \. 

W *(-Q D ) 

5. i Stability of the Recovery Scheme 

We consider here the degree of immunity of the recovery scheme to 
two important types of errors. 

It is assumed first that the input to the recovery system, which we 
shall denote by .s 3 , differs! from s 3 . Let overbarred symbols denote signals 
due to the input s». We have from (15) 
|| Sl _ §, || = || [D _1 (P - P D ) - A-'CB-'P,,]^ - h) 

+ A _, P D {^[B _1 Pi,S3 + w<] - ^[B _1 P D S 8 + u%}\ 
- [D"'(P - P D )B](t06 - w b ) || 

^ ||D _I (P - P D ) - A _1 CB _, Pd 11-11 s 3 - §3 1| 

+ || A _1 P D || /3{ || B _, P || • || s a - s 3 || + || Wb - w b || } 

+ || D _1 (P - P D )B||-|| w,, - w b \\. 

t The departure Of 5a from s 3 might be due to the presence of noise in either 
the transmission channel or the initial stages of the receiver. 
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However, from Theorem II with g = AD '( P — P ).s ;i , 

(22) 



Wb — Wb || ^ z || B 'P || • || Si — S :i 

1 — r 



+ 71 7m \ ! l AD-'(P - P e )||- || 8. - h I 

(1 - r)(] - a) 

Iii view of our earlier assumptions which imply the boimdcdness of all of 
the norms in (21) and (22), it is evident that there exists a positive 
constant /« - 4 such that 

il Si - Si [' ^ Li |! s 3 - s 3 1| (2:5) 

for all -s 3 , s 3 c ©(12). In other words, our assumptions imply that «I> -1 
is bounded. This means that the error in the recovered signal is at most 
proportional to the error in the input to the recovery system. In par- 
ticular, the recovered signal depends continuously on the input to the 
recovery system. 

We show next that the recovery scheme is not critically dependent 
upon either an exact knowledge of the operator J or the projection prop- 
erty of P/, . Specifically, we shall compare the functions Wb and 'Co,, 
defined by 

w b = Rwb , Rwb = J (I — Pd)\^[w„ + w b ] — w b \ 

(24) 
- JAD _1 (P - P D )s 3 

w b = Rw b , Rw„ = Q|#e„ + 1b b ] - th} - SAD~ ! (P - Pd)s 3 (25) 

where Q and S are bounded linear mappings of £«ft into itself. We assume 
that r < 1 and that 

r = || Q || riO) < 1. (26) 

Hence R is assumed to be a contraction mapping of £•>« into itself. Note 
that inequality (2G) is satisfied if r = || J(I — P D ) || ij(l) < 1 and 
|| J(I — Po) — Q || is sufficiently small. A comparison of Wb and w b 
yields an estimate of the error, due to the departure of Q from J( I — P u ) 
and to the departure of S from J, in the limit function approached by 
the iteration procedure in the recovery system. 
From (24) and (25), 

w b - w b = (S - J)AD _I ( P - P„)s, + J(I - P D )W[w a + w b ) - w,,} 

- Q{f[w a + w b ] - w h \ + Q\\p[w„ + Wb] - w b ] - Q{f[w a + Wb] - w b ], 

from which 
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II w b - * II £ II (s - J) A6_1 ( p ~ p ») s 3 II + II Ufl - p *) - Q] 

\f[w] - W b ] || + || Q || »?(1) || W b - Wb ||, 

and 

|| Wb -w b \\^ YZT} 'I (S ~ J) A5_, ( p - P » )ss II 

+ -^-. || [J(I - P D ) - Q][+[u>] - w b ] ||. 

Therefore, if the departure of Q from J(I — P D ) is not too large (i.e., 
if r < 1 ) , the error in the limit function approached by the iteration 
technique is, for fixed s 3 (and hence fixed w), at most a linear combina- 
tion of two terms, one that approaches zero as || S — J || approaches 
zero, and another that approaches zero as || J(I - P c ) - Q || approaches 
zero. 

VI. SOME NEGATIVE RESULTS 

In this final section we consider some results that relate to the neces- 
sity of the conditions introduced earlier. 

The equation yp[w] = Cw + Asi , in which Si e (B(fi), plays a central 
role in defining the mapping <P. As stated in Section 3.5, Theorem II 
implies that this equation possesses a unique solution w c £ 2 * if 

inf | C - 1 | > 1 - a, (27) 

It is of interest to note that there exists a function ^ such that the 
equation \f/[w} = Cw + Asi possesses no solution w e &2 R for any non- 
identically zero Asi if (27) is not satisfied, n is a bounded set, and C = 
c\ where c is a real constant. This follows directly from the fact that if 
(27) is violated, a ^ c ^ (2- a) =/3. Specifically, throughout a 
neighborhood of the origin let \p be independent of / and linear in w with 
slope c. Then clearly, \f/[w] — cw = whenever \w\ < e where e is some 
positive constant. Since As x is assumed to be nonzero almost everywhere, 
the validity of our assertion is evident. 

Let U denote the mapping of the orthogonal complement of (B(fl D ) 
into itself defined by Vw b = (I - P D )^[w a + Wb] - Ew 6 , where w a e 
&(Q d ) and E = C - AD _1 (P - P )B. Theorem II asserts that U 
possesses a bounded inverse if E(u) = C — AD~ l (P — Pd)B, for all co 
contained in the complement of fi D , is bounded away from the disk in 
the complex plane centered at [0,1] and having radius (1 — a). 
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Theorem III: Let y be a real constant and let Si denote an open interval 
contained in the complement of Q D such that E(u) is continuous on Si and 

inf | E(u>) - y | = 0. 

Let \f/ be independent of t and continuously differentiable with respect to x 
on an interval S 2 ivhere 



inf 



d*(x) 



dx 
Then U does not possess a bounded inverse. 



= 0. 



Remark: Note that the hypotheses regarding \p are satisfied if ^ is inde- 
pendent of t, continuously differentiable with respect to x, and y is any 
point on the real-axis diameter of the disk mentioned above. Of course 
we assume that 

inf ~ — = a, and sup = £. 

x dx x dx 

Proof of Theorem III: 

We need the following lemma. 

Lemma III: Let Aj denote the real interval [—T,T], let d and e 2 be real 
positive constants, and let h(t) be a continuous real function defined on Aj . 
Then there exists a function g(t) in the orthogonal complement of ($>(Q D ) 
(assuming that Q D is a proper subset of the real line) such that 

| h(t) - g(t) | g ei , t € (A x - A 2 ) 

ivhere A 2 is a set of points contained in disjoint intervals of total measure 
not exceeding e 2 . 

Proof: 

If the complement of fl D contains an interval centered at the origin, 
the result is known and in fact is true with A 2 the null set. The following 
very direct argument makes use of the known result to treat the case in 
which the complement of fi D does not contain an interval centered at the 
origin. 

Let o>i and co 2 be real positive constants such that the interval [an — a>2 , 
"i + ws], where a>i > co 2 , is contained in the complement of ft D . Let ft' 
be an interval of length 2a> 2 centered at the origin. Let Q' be an interval 
of length 2co 2 centered at the origin. Let {h , t 2 , • ■ • , t n ] = {t \ t e Ai ; 
cos (jiit = 0) . Let If denote an interval of length e 2 /n centered at t, . For 
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any e 3 > 0, there exists a function l(t) e (B(fi') such that 



l(t) - 



cos w\t 



^ e 3 , t e (Ai — A 2 ) 



where A» = U 7, . Choose e 3 such that e 2 = e 3 inf cos utt. It is 

evident that J(J) cos uit possesses the properties of g(l) stated in the 
lemma. 

To prove Theorem III it suffices to show that for any e > 0, there exist 
two functions w ib and w- 2b , belonging to the orthogonal complement of 
(R(fi D ), such that || Wi6 — w 2 b || = 1 and || \p[w a + I0i»] — 4/[w a + w 2b ] — 

E(wu, — w->b) || < e- 

Let € 4 , e 5 , and e 6 be arbitrary positive constants. Since inf \ E(ia) — 

y I — and E(—u) is equal to the complex conjugate of E(u), there 
exists an w £ Hi such that | E(±u 3 ) — 7 I ^ fa • Let IIi and n 2 denote 
two finite intervals of equal length m(IIi) contained in Si and centered, 
respectively, at — wa and +w 3 . Let (wa — w 2b ) £ CB(LTi U n 2 ) with || Wib — 
W2b || = 1. Choose m(Hi) and T such that 

SUp I E(<t>) — 7 I ^ €4 , II Wib — W ib \\\t\>T ^ «b 

where A ;1 is any subset of Ai = [— T,T] with measure not exceeding fa , 

a sufficiently small positive constant. The second inequality can always 

be satisfied since, in accordance with the inequality stated in Section 

4.3, sup I w^ — w 2 b I ^ [t /i(IIi)]. 
t 
Since inf | [fy(x)/dx] — 7 | = 0, there exists a real constant .r £ H 2 

such that 

\p[w a + Wib] — ^k + ^26] 



Wib — W2b 



— 7 



^ €6 



(28) 



whenever | w a + Wi b — x a | and | wu — «H | are sufficiently small. We 
may assume that n(Ui) is so small that the condition on | W\b — w 2b | is 
satisfied. Choose w ib in accordance with Lemma III so that (28) is 
satisfied on (Ai — A 2 ) where A 2 is a set of measure not exceeding /r 6 . 
Let (Ai — A 2 )* denote the complement of (Ai — A 2 ). Observe that 

[| \l/[w„ + wn] — $[w a + 'W 2 b\ — Ef'U'ib — Wo b ) || 

^ || \1/[W„ + Wv] — ^[Wa + W 2b ] — y(Wy b — Wib) || 

+ || (E - 7l)(wib - Wi b ) || 



DISTORTED SIGNALS 111 

^ €6 |l W ib — Wy, || + || \f/[Wa + W\b] - \p[Wa + lV- 2b ] - y{lC lb - VH)\\ (& ^^ 

+ || (E - yl)(w a - w-2b) \\ 

^ tfi + (13 + I 7 I )*5 + || (E - 7 I)( M', 6 - Uhb) || 
^66+(/3H-|t|)«bH-C4. 

This completes the proof. 

APPENDIX 

The purpose of this appendix is to briefly indicate an alternative 
technique for determining sufficient conditions for the recoverability of 

Si . 

Instead of the assumptions stated in Section 3.4 suppose that for some 
real constant \f/ : 

bf \D - B(f - C)~ l A | > 

|| (i/'J — C)~' || rj(^-o) = ess siip | (t/'o — C)~ l | tj(^o) = q < 1. 

These inequalities imply that {PD + PB(^oI — C) _1 A) possesses a 
bounded inverse on (B(^) and that for any g e £«/? the equation \f/[w] = 
Cw + g possesses a unique solution w s £ 2 » . 
From 

$[w] = Cw + As, , s, = PBw + Dsi , (29) 

and \f/[w\ = hiiv + rf[w] we have 

s, = !PD + PB(^,I - Cr'AJs, - PB(<M - C)~VM (30) 
Equation (30) can be written as 

S] - Ms, + !PD + PBdAJ - cr'A}" 1 * 
where 

Ms, = !PD + PBdM - C) -1 A} _1 PB(^«J - C)~VH- 

Of course the dependence of the right-hand side on S, is through w. 

Let w be the solution of \f/[w] = Cw + A.*?! corresponding to S, = si . 
Then by arguments similar to those leading to Theorem II, 

||v-*|| ^ -i-IKW-O-'APll-ll^-iill. 
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Thus M is a contraction mapping of (B(fi) into itself if 

p = || |PD + PBOM - C)- 1 A} _1 PB(^oI - Cr 1 || 

if(^o)[l/(l - ?)] II (M - C) -1 AP || < l. 

Hence if the received signal s 3 is known to be related to the transmitted 
signal Si e (B(fi) by (29), Si can be recovered if our assumptions are 
satisfied and if p < 1. Using arguments similar to those leading to 
Lemma I, 

B ,. x 1 A 



p = ess sup 

OJfJl 



D(4> - C) + BA 



v($o) 



— ess sup 
q uca 



fo-C 
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